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Abstract 

Exploiting sparsity in Semidefinite Programs (SDP) is critical to solving large-scale problems. 
The chordal completion based maximal clique decomposition is the preferred approach for exploiting 
sparsity in SDPs. In this paper, we show that the maximal clique-based SDP decomposition is 
primal degenerate when the SDP has a low rank solution. We also derive conditions under which 
the multipliers in the maximal clique-based SDP formulation is not unique. Numerical experiments 
demonstrate that the SDP decomposition results in the schur-complement matrix of the Interior 
Point Method (IPM) having higher condition number than for the original SDP formulation. 


1 Introduction 

Semidefinite programming (SDP) is a subfield of convex optimization concerned with the optimization of 
a linear objective function over the intersection of the cone of symmetric positive semidefinite matrices 
with an affine space. Many problems in operations research and combinatorial optimization can be 
modeled or approximated as SDPs dUSj. For an SDP defined over the set of nx n symmetric matrices 
the number of unknowns in the problem grows as 0(n 2 ). Since the seminal work of Nesterov and 
Nemirovskii [S]i Interior Point Methods (IPMs) have become the preferred approach for solving SDPs. 
The complexity of the step computation in IPM is typically 0(mn 3 + m 2 n 2 ) [TUI . 

Given the quadratic, cubic growth in m, n of the computational cost respectively, it is imperative 
to exploit problem structure in solving large-scale SDPs. For SDPs modeling practical applications, 
the data matrices involved are typically sparse. Denote by, N = {1, ...,n} and by E = {(i,j) \ i 7 ^ 
j, th entry of some data matrix is non-zero}. The set E, also called the aggregate sparsity pattern, 

represents the non-zero entries in the objective and constraint matrices, that is the sparsity in the 
problem data. Consequently, only the entries of the matrix variable corresponding to the aggregate 
sparsity pattern are involved in the problem. From the computational stand-point it is desirable to work 
only with such entries to reduce the number of unknowns in the problem from 0(n 2 ) to 0(\E\). However, 
the semidefinite constraint couples all of the entries of the symmetric matrix. Fukuda et al [33 exploit 
the result of Grone et al [B] to decompose the SDP defined on n x n symmetric matrices into smaller 
sized matrices. Grone et al d Theorem 7] states that for a graph G(N, E) that is chordal: the positive 
semidefinite condition on n x n matrix is equivalent to positive semidefinite condition on submatrices 
corresponding to the maximal cliques that cover all the nodes and edges in the graph G(N, E). Nakata et 
al , 8 j implemented the decomposition within a SDP software package SDPA T4] and demonstrated the 
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scalability of the approach. More recently, the authors of SDPA have also extended the implementation 
to take advantage of multi-core architectures [ISHH3- More recently, Kim and Kojima ijj extended this 
approach for solving semidefinite relaxations of polynomial optimization problems. 

1.1 Our Contribution 

In this paper, we study the properties of the conversion approach of which converts the original 
SDP into an SDP with multiple sub-matrices and additional equality constraints. We show that the 
SDP resulting from the conversion approach is primal degenerate when the SDP solution has low-rank. 
We show that this can occur even when the solution to the original SDP is primal non-degenerate. Thus, 
this degeneracy is a consequence of the conversion approach. We also derive conditions under which 
the dual multipliers are non-unique. We demonstrate through numerical experiments that condition 
numbers of schur-complement matrix of IPM are much higher for the conversion approach as compared 
with the original SDP formulation. To the best of our knowledge, this is the first result describing the 
degeneracy of the conversion approach. 

The rest of the paper is organized as follows. introduces the SDP formulation and the maximal 
clique decomposition. The conversion approach |4] is described in § @ proves the primal degeneracy 
and dual non-uniqueness of the conversion approach. Numerical experiments validating the results are 
presented in lj5] followed by conclusions in fj 6 ] 

1.2 Notation 

In the following, R denotes the set of reals and R™ is the space of n dimensional column vectors. For a 
vector x £ R", \x\i denotes the i-tli component of x and 0 n £ R" denotes the zero vector, e; £ R™ the 
vector with 1 for the *-th component and 0 otherwise. The notation diag(Ai,..., A„) denotes a diagonal 
matrix with the values Aj on the diagonal. Given a vector v £ R n and subset C C {1,..., n}, Vc denotes 
the subvector composed of [t>]j for i £ C. § n denotes the set of n x n real symmetric matrices and 
§" (8" , ) denotes the set ofnxn real symmetric positive semi-definite (definite) matrices. Further, 
A h WO denotes that A £ 8" (8++)- For a matrix A £ S n , [.A]ij denotes the (i,j)- th entry of the 
matrix A and rank(A) denotes the rank of A. For a pair of matrices A\, A^ £ 8", range{Ai, A 2 } denotes 
the subspace of symmetric matrices spanned by A\, A^. Denote by N = {1,..., n}. The notation A* B 
denotes the standard trace inner product between symmetric matrices A* B = XWi [A]ij [Wo f° r 
A, B £ 8". For sets C s , C t C N and A £ S n , Ac B c t is a |C S | x |C t | submatrix of A formed by removing 
rows and columns of A that are not in C s , Q respectively. 

1.3 Background on Graph Theory [2] 

In this paper we only consider undirected graphs. Given a graph G(N, F), a cycle in F is a sequence 
of vertices {in * 2 , ■ ■ ■ , i 9 } such that ij 7 ^ ip, {ij,ij+ 1 ) £ F and [i q ,i 1 ) £ F. The cycle in F with q edges 
is called a cycle of length q. Given a cycle {ii,-- ■ ,i q } in F, a chord is an edge ( ij,ij') for j,f that are 
non-adjacent in the cycle. A graph G(N, F) is said to be chordal if every cycle of length greater than 3 
has a chord. Given G(N, F), F' D F is called a chordal extension if the graph G'(N, F') is chordal. Given 
a graph G(N ,F), C C N is called a clique if it satisfies the property that (i,j) £ F for all i,j £ C. A 
clique C is maximal if there does not exist clique C' D C. For a chordal graph, the maximal cliques can 
be arranged as a tree, called clique tree , T(N,£) in which J\f = {Ci,..., C^} and (C s , C t ) £ £ are edges 
between the cliques. The interested reader is referred to [2] for an in-depth exposition of chordal graphs 
and clique trees. 
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1.4 Matrix Terminology |4] 

For a set FcNxN, § ra (F) denotes the set of symmetric nx n matrices with only entries in F specified. 
A matrix X £ S n (F) is called a symmetric partially specified matrix. A matrix X £ S n is called a 
completion of A £ S"(F) if [Xfij = [X]ij for all (i,j) £ F. A completion X £ S™ of X £ S"(F) that is 
positive semidefinite (definite) is said to be a positive semidefinite (definite) completion of X. 


2 Maximal Clique Decomposition in SDP 

Consider the following SDP: 

min An • X 

xeS" 

s.t. A p • X = b p V p = 1,..., m (1) 

ISO 

where A p £ S™. Denote by E = {(i,j) | * 7 ^ j, [ A p]ij 7 ^ 0 for some 0 < p < m}. The set E, also 
called the aggregate sparsity pattern g], represents the non-zero entries in the objective and constraint 
matrices, that is the sparsity in the problem data. Clearly, only the entries \X\jk for (j, k) £ E feature 
in the objective and equality constraints in ([I]). In a number of practical applications, |E| << n 2 . From 
a computational standpoint, it is desirable to work only with [X]jk for (j, k ) £ E. In other words, we 
want to solve 

min V' [A 0 ]ij[X] Z j 

*eS"-(E) 

(»,i) 6E 

s.t. ^2 i A p]ij[X]ij = b p V p = 1,..., m ( 2 ) 

(*b)e e 

X has a positive semidefinite completion. 

The result of |F provides the conditions under which such a completion exist. We state this below in a 
form convenient for further development as in j2J Theorem 2.5]. 

Lemma 1 (^[ Theorem 2.5]). Let G(N, F) be a chordal graph and let {Ci,... .Q} be the family of all 
maximal cliques. Then, X £ S n (F) has a positive semidefinite (definite) completion if and only if X 
satisfies 

Xc B c B h 0(>~ 0) Vs = 1 ,...,£ (3) 

Using Lemma [l] Fukuda et al [§j proposed the conversion approach which we describe next. 


3 Conversion Approach 

Given the graph G(N, E), with E the aggregate sparsity pattern of SDP ®, the conversion approach g] 
proceeds by : (a) computing a chordal extension F D E; (b) the set of maximal cliques A f = {C 1; ..., C e } 
of the graph G(N, F) are identified; (c) the clique tree is computed; and (d) a SDP is posed in 

terms of matrices defined on the set of maximal cliques that is equivalent to SDP in ([!]). Additional 
equality constraints are introduced to equate the overlapping entries in the maximal cliques. Prior to 
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stating the SDP formulation we introduce notation that facilitates further development. Denote, 


[A s ,p]a e (i)cr s (j) — 


a s : N —► {1,..., | C s |} mapping the original 
indices to the ordering in the clique C s 
[A p ]ij if s = min {t | ( i,j) £ CJ 
0 otherwise 


Es,ij — 2 ^ e cr s (i) e cr s (j) e < T s(j) e rT s (i)'j ^ 

(s,t) £ T <==>■ (C s ,C t ) € £ 

c s t = c s n Ct 

where e (7s ^ £ Rl c »L The SDP in 0 can be equivalently posed using the above notation as, 

l 

^ • V s . 


mm 

A',6Sl c »l 


5 — 1 


s.t. ^ A s ,p • X s = b p V p = 1,..., m 

5=1 

^s,ij * X s ^t,ij * ^ i — ji b j £ C s ^, 

(s, t) £ £ 

X s P0 Vs = 


( 4 ) 


(5) 


We refer to the SDP in ([5]) as the conversion SDP. In the following we present and analyze an analogue 
of the conversion approach for linear programming. The analysis shows that primal degeneracy results 
for the linear program under certain assumptions. Formal proofs for primal degeneracy of conversion 
SDP are left for lj4] 


3.1 Intuition for Primal Degeneracy 

To motivate the primal degeneracy of conversion SDP we provide a conversion approach inspired de¬ 
composition for linear programs (LPs). Consider a LP of the form, 

T 

mm a n x 

xGR" 

s.t. OpX = bp V p = 1,..., m (6) 

x > 0 

where a p £ R” and b £ R m . Suppose we decompose the LP ([b]) using the sets in {Ci,..., Q} as, 

5Z a o,s x s 

S= 1 

l 

p x s = b p Vp = 1,... ,m (7) 

S=1 

[^s]crLP^) V i G C s t, (s, t) G £ 

x s > 0 V s = 1,... 


min 

a; s eRi c si 


s.t. 
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where 


°s ; N —>• {1, - - -, |C s |} 

r i f [a p \i if s = min{f|j € C t } 

= 0 otherwise 


With the above definition of the matrices it is easy to see that the LPs in ([6 ) and 0 are equivalent. 
Further, if x* is an optimal solution to LP |6| then, x* = x^ b is optimal for (7|. Suppose, there exists 
i £ C s nC f for which [x*]i = 0 then, the set of constraints 


[ a 's]crJ p (i) [‘*'t]<T pp (i) 

[^s]^P(i) = 0, [x t \ a LP(i) = 0 

are linearly dependent. The linear dependency of the constraints can be avoided if the nonnegative 
bounds on shared entries are enforced exactly once for each index i. For example, the non negativity 
constraints in ([7]) can be enforced for each i £ N: 

[o; s ] ct lp W > 0 if s = min{f|i £ C t }. 

In summary the degeneracy occurs due to a shared element activating the bound at the solution. In 
a direct analogy, the conversion SDP in ([5]) is primal degenerate when, rank(Ac st c st ) < |C s< |. This 
degeneracy is directly attributable to the duplication of the semidefinite constraints for the submatrix 
Xc st c a t i n both X s y 0 and X t >z 0 for every pair of (s,t) £ T : s / t. Unfortunately, the duplication 
of the semidefinite constraints cannot be avoided in the case of SDP without losing the linearity. We 
provide formal arguments for the degeneracy and dual multiplicity of the conversion SDP ([5]) in the 
following section. 


4 Primal Degeneracy &; Dual Non-uniqueness of Conversion 
Approach 

We review the conditions for primal non-degeneracy and dual uniqueness for the SDP (in introduced 
by Alizadeh et al ;ll in 14-1 We also extend this notion to that of the conversion SDP pE 14.2 proves 
the primal degeneracy result for the conversion approach and §4.3| proves the dual non-uniqueness. 


,A r ,0,...,0)Q T 

( 8 ) 

(9) 

( 10 ) 


4.1 Primal Nondegeneracy and Dual Uniqueness in SDPs 

Suppose X £ § n with rank(X) = r with eigenvalue decomposition A' = Qdiag(Ai,. 
then, the tangent space Tx of rank-r symmetric matrices is 


U V 
V T 0 


Tx = | Q 

and the space orthogonal to Tx is given by, 

t^ = (q 


Q 1 


U £ § r , V G 


0 0 
0 W 


Q 3 


WeS” 


The null space of equality constraints is, 

Na = {Y £ § ra |A p = 0 V p = 1,..., m} 

and the space orthogonal to Na is given by, 

= span{{A p }™ =1 }. 


( 11 ) 
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Definition 1 ([!])• Suppose X is primal feasible for ([I]) with rank(X) = r, then X is primal nondegen¬ 
erate if the following equivalent conditions hold: 


T x + 



(12a) 

S' 

II 

-K 

£ 

C 

j 



(12b) 

E a P A P e E — 

=> a p = 0 Vp = 1, .. 

., m. 

(12c) 


p=i 


Lemma 2 ([TJ Theorem 2]). Suppose A'* G S n is primal nondegenerate and optimal for 0. Then 
the optimal dual multipliers for the equality and positive semidefinite constraints respectively, 

satisfying the first order optimality conditions (13) are unique, 


m 

A 0 + J2(*p A p-S* =0 

p=i 

Ap» X* = b p V p = 1,..., to 
X*,S* h 0, X*S* = 0. 


(13) 


We extend the notions of non-degeneracy to the conversion SDP |5]) in the following. The tangent 
space for the matrices X s is defined as, 


| Qs 

and the space orthogonal to T S) x is 


U V 
V T 0 


q: 


UeS r %V G R r * x (l c - | - r ')| 


— i Qs 


0 0 
0 w 


Qi 


W£ §i c =i-^ 


(14) 


(15) 


where X s = Q s diag(Ai,..., A r> , 0,..., 0) ( Q S ) T and r s = rank(A, s ). The tangent space for the conversion 
SDP ^ is denoted by T and the space orthogonal to the tangent space is denoted by T 1 - are, 

T = xf =1 T S;X and T 1 - = xf =1 T^ Y . 

The null space of equality constraints for the conversion SDP 0 is, 


N = 


x 


£ 

s =1 


y s g s |Cs| 


i 

E As,p •y s = 0Vp=l,...,m 

S—l 

Es,ij • Eg = E't,ij • Yt 
v i < j,i,j G C st , (s,t) G £ 


(16) 


The nullspace for conversion SDP ([5]) couples all the matrices corresponding to cliques. The space 
orthogonal to N denoted by N x is a lot more convenient to work with since it can be written as product 
of spaces. The range space of the constraint matrices corresponding to a particular clique C s is given 

by, 

for some a p 
p= l,...,m, 


' m 

P= 1 




E E 


fist,ij Es,ij 




(17) 


t:(s,t)e£ i<jec st 

E E Pts,ijE 


s,ij 


i < j G c st 

not all 0 


t:(t,s)££ i<jECts 
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The range space of the conversion SDP is, 


N - 1 


for some {{a p }™ =1 , 

{flst,ij}(s,t)££,i<je C st ) 7^ 0 


(18) 


Analogous to Definiton[l] the conditions for primal non-degeneracy of conversion SDP is stated below. 

Definition 2. Suppose {X s }^ =1 is primal feasible for ([5]) with rank(X s ) = r s , then {X s } is primal 
nondegenerate if the following equivalent conditions hold: 

T + N = S” (19a) 

T 1 nN 1 = {(5} (19b) 


where n = ^ =1 ||C S |(|C S | + 1). 


4.2 Primal Degeneracy of Conversion SDP 

Assumption 1. The SDP (JT|) has an optimal solution X* with rank{X*) < |C st | for some ( s,t ) £ £. 

In the following we denote by X* the optimal solution to the conversion SDP ([5]). The following 
result is immediate. 


Lemma 3. rank(X*) < rank{X*) V s = 1 

Proof. By definition, X* = X £ c is a principal submatrix of X*. The claim follows by noting that the 
rank of any principal sub-matrix cannot exceed that of the original matrix. □ 


The following result characterizes the eigenvectors of the matrices X*,X t * for cliques s,t satisfying 
Assumption [l] Without loss of generality and for ease of presentation, we assume that the shared nodes 
of C s , C t are ordered as, 

cr s (i) = er t (i) and 1 < cr s (i) < |C st | V i £ C st . (20) 

Lemma 4. Suppose Assumption [7] holds for cliques s,t. Then, there exists u £ K) Ce,t l such that v s = 
[u T OjO t |] T is a 0- eigenvector of X* and v t = [u T 0j^ ( ^ c t |] T is a 0-eigenvector of Xf. 

Proof. From Lemma[3j we have that rank(A*), rank(X t *) < rank(X*) < |C s t| where the second inequal¬ 
ity follows from Assumption [l] Applying Lemma [3] X* , Xf , it is also true that the submatrix of X*,Xf 
corresponding to C s t must have rank smaller than |C s *|. Hence, there exists a vector u £ K) Cst l that lies 
in the nullspace of the principal submatrix Xc Bt c st - Defining the vector v s = [ u T Oj^- ^ and taking 
the right and left products with v s of the matrix A"*, 


vJX* s v s = u T (X* s ) Cat c st u = 0 




v s is in the span of 0 — eigenvectors of X* 
==4> v s is a 0 — eigenvector of X* 


The claim on X* can be proved similarly and this completes the proof. □ 

We can now state the main result on the primal degeneracy of the conversion SDP ([5]) . 

Theorem 1. Suppose Assumption [7] holds. Then, the solution X* of the conversion SDP ([5]) is primal 
degenerate. 
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Proof. Suppose there exists scalars a p ,/3 st ,ij ^ 0 such that 


y ^ &pA s ,p H - 

E 

El Pst,ijEs,ij £ 

p= i 

(s,£)e£ i<j£C s t 

m 

y^ a pAt,p— 

E 

El Pst,ijEt,ij £ TTj jsf, 

p= i 

(s,t)££ i<j£C st 


( 21 ) 


holds. Then, we have that X* is primal degenerate since the condition in (19b) does not hold. In the 
following we will denote by s,t a pair of cliques satisfying Assumption [l] We will show in the following 
that: 

Psi.ij for (M) = (M) 

0 otherwise 


®-p 0? 


( 22 ) 


satisfies (21). The choice in ( |22| results in the left hand side of (21) evaluating to 0 for all (s, t) (s, t). 
Thus, (21) holds trivially for all (s,t) ^ (s,t ) since 0 G T^,, Tf x * ■ I 11 the rest of the proof we will 
consider only the cliques (s,f) = (s,t). 

By Lemma Q and (Jl5|, v s vj G and v t vj G T^ x „. Define /3 st ,ij = E s>i j • {v s vj) = vjE Stij v s . 

By definition of 0 s t,iji 

(23) 


'J S V S — ^ ) Pst,ij E s ,ij. 

i<jec Bt 


By definition of v s ,vt in Lemma 4 and (20), we also have that v t vj = Yli<iec. Pst,ijEt,ij- Thus, the 


choice in (|22|) satisfies (|21|) . This completes the proof. 


□ 


4.3 Dual Non-uniqueness in Conversion SDP 

The solution X* and multipliers Q, p , S* satisfy the first order optimality conditions for the con¬ 
version SDP g for all s = 1,..., £, 


4s,o + El Ca.p-^s.p + El £.st,ijE s ,ij 

P= 1 t:(s,t)e£ i<j&Cst 

E E £ts,ijEs,ij ~ S* = 0 

t:(t,s)€£ i<j£C ts 


(24) 


J2^s, p *x: = b p 

s =1 

E 8ti j • X* = E t 

x* s ,s* s ho,x* s s; = o. 


y* 

lj t,ij • -A-t 


Theorem 2. Suppose Assumption^holds and vjS*v s > 0 orvf S*vt > 0. Then, the optimal multipliers 
for the conversion SDP ([5]) are not unique. 

Proof. Let £* ,£*satisfy the first order optimality conditions (241 for the conversion SDP |5]). 
In the following we show by construction the existence of other multipliers satisfying the conditions 
in (24) for the cliques (s,f) as defined in Theorem [lj In the rest of the proof (s,t) = (s,t). Suppose, 













vf S*v s = 7 > 0. Since, v s is a 0-eigenvector of X* (Lemma [ 4 ]) and X*S* 
also an eigenvector of S*. Thus, for all 0 < <5 < 7 , 


0 (241 we have that v s is 


X:(S* s - Sv s vJ) = 0,5: - 6v s vJ h 0 
Xl(S* t + 6v t vf) = 0, S* t + Sv s vJ h 0 


(25) 


Following the proof of Theorem |T] we have that there exist 0 s t,ij such that (23) holds. Hence, 


(£st,ij fi0at,ij)E S ,ij {S s 3 v sV s ) 

= y Ct,ijE s ,ij - s*. 


Further, by Lemma [4] we also have that, 


E (Cm; ^ - (s? + Svtvf) 

i<jec at 

V ~ s; 

i<jec at 

+ I ^ ( 3Pst,ij bVf Vf 

\i<jec st 

= - E - S t + K v tvJ - V t vJ) 

i<jec at 

= - E 

i<jec at 


Thus, for any 0 < <5 < 7 replacing ^* t i j,S*,S^ with 


c* 


+ 6/3 s t ti j,S* - Sv s vJ, Sf + Sv t vf 


will also result in satisfaction of the first order optimality conditions in (24). Hence, the multipliers are 
not unique when vfS*v s > 0. The proof follows in an identical fashion for vf S^i’t > 0. This completes 
the proof. □ 


5 Numerical Experiments 


We demonstrate the results of the previous section through numerical experiments on a simple SDP. 
Consider the SDP with data 


An 


' 

110 1 
10 11 
0 111 


, Ap — OpCp ,bp — 1 Vp — 1, - - -,4. 


(26) 
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This form of the SDP has the same structure as the SDP relaxation for MAXCUT investigated by 
Goemans and Williamson [5]. The eigenvalues and eigenvectors of A 0 are, 


An — 


-10 0 0 
0 10 0 

0 0 10 

0 0 0 3 


! Q 0 — 


0 

1 

-^2 

v/2 

0 


1 

y/2 

0 

0 

_]_ 

Vs 


Since A 0 has the smallest eigenvalue to be —1, the optimal solution to the SDP defined by (26 1 is 


X* = 4 qiqf where q± is the first column of Q o (the eigenvector of Aq corresponding to eigenvalue of 
— 1). The factor 4 ensures that the equality constraints are satisfied. 


5.1 Primal Non-degeneracy of X* 


We show in the following that X* is primal non-degenerate by verifying satisfaction of (12c). From the 
definition of T^- in © we have, 


Ti = 


Q 


0 0 
0 w 


Q 


We s 3 


Suppose, there exists (oq,... , 0 : 4 ) 7 ^ 0 such that (12c) holds, 

4 4 


apAp e T 

p= 1 


^ ( a p Q A P Q — 

p=i 


0 0 
0 w 


(27) 


for some If £ § 3 . In order for (27) to hold the first column of the matrix on the left hand side of (27) 
must be 0 for some {a p } 7 ^ 0. We show that such a p does not exist. The condition that the first column 
of X)p=i ct p Q T ApQ is 0 can be written as, 

4 4 

0 — ^ ( (XpQ ApQei — ^ ( &p(Q ^p)(^pQi) 

p —1 p —1 

oti{qi\i 

= ^]{Q T e p )([qi] p a p ) = Q 1 


P= 1 


_a±[q 
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Since Q T is a non-singular matrix the above can only occur if [qi\ p a p = 0 for all p. Since [qqjp 7 ^ 0 


this implies that a p = 0 for all p = 1,... ,4. Thus, (27) does not hold for a p 7 ^ 0 which proves the 
non-degeneracy of X*. 


5.2 Conversion SDP 


For the data in (26 1 , the graph of the aggregate sparsity pattern is depicted in Figure [1(a)] The G(N, E) 
is a 4-cycle and not chordal. Figure |l(b)| shows a chordal extension where an edge (2, 3) has been 


introduced. The maximal clique decomposition for the chordal graph G(N, F) is shown in Figure 1(c) 


Note that we have ordered the vertices such that (20) for ease of presentation. The conversion SDP is 
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Figure 1: |(a)| Graph of the original SDP. |(b)| Graph of the chordal completion. m Maximal clique 
decomposition of chordal completion. 


given by the data, 


C 1 = {2,3,1},C 2 = {2,3,4} 



'1 

0 

1' 


'0 

0 

1 ' 

II 

0 

0 

1 

1 

V 

to 

0 

II 

0 

0 

1 


1 

1 

1 


1 

1 

1 


^ 1,1 — &3 e 3 > ^ 2,1 — 0; Ai 2 — eie}\ A 22 — 0 
^ 1,3 = e 2 e^, A 2j3 = 0; A- t 4 = 0, A 2i 4 = e 3 e 3 

^1,22 = -E'2,22 = = E 2> 23 = -( ei 4 + e 2 e '[) 

^1,33 = -^2,33 = e 2 e^\ 

The solution to the conversion SDP is, 





f 1 -1 

f 1 -1 

-1 -1 1 


Clearly, rank(A'{) = rank(A'f) 
values of A} are, 


Ai 


1 < |Ci 2 1. Hence, Assumption [I] holds. The eigenvectors and eigen- 


r 

0 



" 1 

1 

1 ■ 

3 

0 


V3 

Ve 

V 2 

0 

0 

0 

,Qi — 

1 

Vs 

1 

\/6 

1 

y/2 

0 

0 

0 


1 

L Vs 

2 

V^6 

0 


5.3 Primal Degeneracy 

As shown in Lemmawe have that u = [^ ^] T is a 0-eigenvector of the submatrix which corresponds 

to the intersection of the cliques, Ci 2 . As shown in Lemma [ 4 J v\ = v 2 = [u T 0] T are 0-eigenvectors of 
X*. X 2 respectively. 

From the definition of it is easy to see that, 
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Similarly, it can be shown that 
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— -^{ — E2,22) ~ ( — E 2 ,23) + ^( _ E 2 ’ 33 ) 


Thus, there exists an element in and T;f A -» that is in the span of the constraints that equate the 

elements in C 12 . Hence, the conversion SDP is primal degenerate. 


5.4 Non-unique Multipliers 

For the original SDP, the optimal multipliers are, 
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For the conversion SDP, multipliers satisfying (24) are 

>£12,22 = 1 ) £12,23 = 0 , £12,33 
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The eigenvectors of S%,S% are Q\ while the eigenvalues are, 

0 0 0 ‘ 
Asi = A 52 =030 
0 0 1 


Thus it is easy to see that Xf S* = 0 and they satisfy strict complementarity. The same is also true 
of X? 2 and S% ■ The eigenvalue of v\ is 1 and satisfies the conditions in Theorem [2] and hence, for all 
0 < S < 1 , 

SJ - Svivf h 0,X*(S* - dv lV f) = 0 

(£l2,22 — 2 ^El 2 ,2 2 + (£l2,23 + $)El2,23 

+ (£l2,33 _ 2$)El2,33 - (St - SviVi) 

= £12,22^12,22 + £12,23-^12,23 + £12,33-^12,33 — st 


12 




















Figure 2: Plot of the condition number of the schur-complement matrix in the IPM against the optimality 
gap. o - original SDP formulation, A - conversion SDP. 


Further, it can also be shown that, 

(£*2,22 ~ -£)( —£12,22) + (£12,23 + < 5 )(--Ei 2 , 23 ) 

+ (£l2,33 - ^)(-^!2,3 3 ) - (S* 2 + 6V 2 VJ) 

= — £l2,22^12,22 — £12,23^12,23 — £l2, 3 3^12,33 — S 2 

S% + 8v 2 v// >r 0, X£(s; + Sv 2 v 2 ) = 0. 

Thus, we have that the multipliers 

C * C* ^ £ C * _L A ^ A 

1 1 S2 ) S12,22 — S12.23 + S12,33 — 

S* + Svivf, S 2 + Sv 2 v 2 

also satisfy the first order optimality conditions for conversion SDP. This shows that there are an infinite 
set of multipliers for the conversion SDP. 

5.5 Ill-conditioning in IPM 

Since the multipliers are not unique, the matrix used in the step computation of the IPM for SDP 
must be singular in the limit. Figure [2] plots the condition number of the schur-complement matrix 
in SDPT3 [12] against the optimality gap. SDPT3 takes 7 iterations to solve either formulation. But 
the plot clearly shows that the condition number of the schur-complement matrix is higher for the 
conversion SDP. This is attributable to the non-uniqueness of the dual multipliers. The plot shows that 
conditioning for the conversion SDP grows as 0(1//i 2 ) as opposed to 0(1/n) for non-degenerate SDPs. 
This observation is consistent with the analysis of Toh HU- 

6 Conclusions &; Future Work 

We analyzed the conversion approach for SDP proposed by Fukuda et al [4] . The analysis showed that for 
SDPs with a low rank solution, the conversion SDP was primal degenerate. We also provided conditions 
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under which the multipliers for the conversion SDP were non-unique. The theory was exemplified using 
a simple 4x4 SDP. In the example, the ill-conditioning in the schur-complement matrix was greater for 
the conversion SDP. Nevertheless, this did not affect the number of iterations to reach the said tolerance. 
We believe the effect of the ill-conditioning is likely to be more dramatic for larger problems and affect 
convergence of IPM. This will be investigated in a future study. 
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